A New Definition of the Entropy of General Probability Distributions Based on the Non-Standard Analysis
نویسنده
چکیده
Based on the non-standard analysis by Robinson, a new definition of the entropy of general distributions is given as a straightforward extension of Shannon's discrete entropy. The newly defined entropy has natural properties such as positiveness and invariance under transformations unlike Shannon's continuous entropy. In the light of this new definition, the meaning of Shannon's continuous entropy will be more clearly seen.
منابع مشابه
Velocity Distribution in the 90-degree Bend based on the Probability and Entropy Concept
Practical concept of velocity distribution of pressure flow in the bends is interesting and hence, the professional engineering design has been investigated in the current study. This paper shows that velocity distribution in the bends can be analyzed in terms of the probability distributions. The concept of entropy based on the probability is an applied and new approach to achieve velocity pro...
متن کاملA Preferred Definition of Conditional Rényi Entropy
The Rényi entropy is a generalization of Shannon entropy to a one-parameter family of entropies. Tsallis entropy too is a generalization of Shannon entropy. The measure for Tsallis entropy is non-logarithmic. After the introduction of Shannon entropy , the conditional Shannon entropy was derived and its properties became known. Also, for Tsallis entropy, the conditional entropy was introduced a...
متن کاملClassification and properties of acyclic discrete phase-type distributions based on geometric and shifted geometric distributions
Acyclic phase-type distributions form a versatile model, serving as approximations to many probability distributions in various circumstances. They exhibit special properties and characteristics that usually make their applications attractive. Compared to acyclic continuous phase-type (ACPH) distributions, acyclic discrete phase-type (ADPH) distributions and their subclasses (ADPH family) have ...
متن کاملDetermination of Maximum Bayesian Entropy Probability Distribution
In this paper, we consider the determination methods of maximum entropy multivariate distributions with given prior under the constraints, that the marginal distributions or the marginals and covariance matrix are prescribed. Next, some numerical solutions are considered for the cases of unavailable closed form of solutions. Finally, these methods are illustrated via some numerical examples.
متن کاملBivariate Extension of Past Entropy
Di Crescenzo and Longobardi (2002) has been proposed a measure of uncertainty related to past life namely past entropy. The present paper addresses the question of extending this concept to bivariate set-up and study some properties of the proposed measure. It is shown that the proposed measure uniquely determines the distribution function. Characterizations for some bivariate lifetime models a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Information and Control
دوره 47 شماره
صفحات -
تاریخ انتشار 1980